On parameter estimation for delay models with discontinuous right-hand sides

We study delay models with discontinuous right-hand side. Lack of smoothness in the solutions of such problems may have serious consequences for parameters estimation using gradient-based approaches. Additionally, it may cause ambiguities in the parameter determinability analysis applied on the parameter estimates. In order to overcome these difficulties, we suggest a standard regularization technique to make the model continuous. We prove the convergence of the solution of the regularized model to the solution of the original problem. As a consequence of that, parameter estimates inferred from the regularized model converge to the corresponding estimates of the original problem. We support our findings with numerical illustrations for simple test problems

Parameter estimation for a model of gap gene circuits with time-variable external inputs in Drosophila

We study a model for spatio-temporal pattern formation of gap gene products in the early development of Drosophila. In contrast to previous studies of gap gene circuits, our model incorporates a number of proteins as time-variable external inputs, including a protein Huckebein which is necessary for setting up the correct posterior domain boundary and its shift in time for the gap gene hunchback. Unknown model parameters are inferred by fitting the model outputs to the gap gene data and statistical analysis is applied to investigate the quality of the parameter estimates. Our results, while being consistent with previous findings, at the same time provide a number of improvements. Firstly, it takes into account correct regulation of hunchback at the posterior part of the embryo. Secondly, confidence interval analysis shows that the regulatory topology of the gene network in our model which consists of parameters representing the regulation between genes is more consistent with the experimental evidences. Our results also reveal that for data fitting the Weighted Least Squares sum is a more suitable measure than the Ordinary Least Squares sum which has been used in all previous studies. This is confirmed by a better fit of the boundaries of the gap gene expression domains and an absence of patterning defects in the model outputs, as well as by a correct prediction of mutant phenotypes

Generalizations of Gronwall's integral inequality and their discrete analogies

The generalizations of Gronwall's integral inequality and their discrete analogies are obtained. In applications these results are used to obtain the stability estimates of solutions for the initial value problems for integral-differential equations of the parabolic typ

On the numerical solution of diffusion-reaction equations with singular source terms

A numerical study is presented of reaction-diffusion problems having singular reaction source terms, singular in the sense that within the spatial domain the source is defined by a Dirac delta function expression on a lower dimensional surface. A consequence is that solutions will be continuous, but not continuously differentiable. This lack of smoothness and the lower dimensional surface forms an obstacle for numerical discretization, including amongst others order reduction. In this paper the finite volume approach is studied for linear and nonlinear test models. The aimed application field lies in developmental biology from which a test model is used for numerical illustratio

Efficient reverse-engineering of a developmental gene regulatory network

This is the final version of the article. Available from the publisher via the DOI in this record.Understanding the complex regulatory networks underlying development and evolution of multi-cellular organisms is a major problem in biology. Computational models can be used as tools to extract the regulatory structure and dynamics of such networks from gene expression data. This approach is called reverse engineering. It has been successfully applied to many gene networks in various biological systems. However, to reconstitute the structure and non-linear dynamics of a developmental gene network in its spatial context remains a considerable challenge. Here, we address this challenge using a case study: the gap gene network involved in segment determination during early development of Drosophila melanogaster. A major problem for reverse-engineering pattern-forming networks is the significant amount of time and effort required to acquire and quantify spatial gene expression data. We have developed a simplified data processing pipeline that considerably increases the throughput of the method, but results in data of reduced accuracy compared to those previously used for gap gene network inference. We demonstrate that we can infer the correct network structure using our reduced data set, and investigate minimal data requirements for successful reverse engineering. Our results show that timing and position of expression domain boundaries are the crucial features for determining regulatory network structure from data, while it is less important to precisely measure expression levels. Based on this, we define minimal data requirements for gap gene network inference. Our results demonstrate the feasibility of reverse-engineering with much reduced experimental effort. This enables more widespread use of the method in different developmental contexts and organisms. Such systematic application of data-driven models to real-world networks has enormous potential. Only the quantitative investigation of a large number of developmental gene regulatory networks will allow us to discover whether there are rules or regularities governing development and evolution of complex multi-cellular organisms.Funding: The laboratory of Johannes Jaeger and this study in particular was funded by the MEC-EMBL agreement for the EMBL/CRG Research Unit in Systems Biology, by Grant 153 (MOPDEV) of the ERANet: ComplexityNET program, by SGR Grant 406 from the Catalan funding agency AGAUR, by grant BFU2009-10184 from the Spanish Ministry of Science, and by European Commission grant FP7-KBBE-2011-5/289434 (BioPreDyn). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Gene circuit analysis of the terminal gap gene <i>huckebein</i>

The early embryo of Drosophila melanogaster provides a powerful model system to study the role of genes in pattern formation. The gap gene network constitutes the first zygotic regulatory tier in the hierarchy of the segmentation genes involved in specifying the position of body segments. Here, we use an integrative, systems-level approach to investigate the regulatory effect of the terminal gap gene huckebein (hkb) on gap gene expression. We present quantitative expression data for the Hkb protein, which enable us to include hkb in gap gene circuit models. Gap gene circuits are mathematical models of gene networks used as computational tools to extract regulatory information from spatial expression data. This is achieved by fitting the model to gap gene expression patterns, in order to obtain estimates for regulatory parameters which predict a specific network topology. We show how considering variability in the data combined with analysis of parameter determinability significantly improves the biological relevance and consistency of the approach. Our models are in agreement with earlier results, which they extend in two important respects: First, we show that Hkb is involved in the regulation of the posterior hunchback (hb) domain, but does not have any other essential function. Specifically, Hkb is required for the anterior shift in the posterior border of this domain, which is now reproduced correctly in our models. Second, gap gene circuits presented here are able to reproduce mutants of terminal gap genes, while previously published models were unable to reproduce any null mutants correctly. As a consequence, our models now capture the expression dynamics of all posterior gap genes and some variational properties of the system correctly. This is an important step towards a better, quantitative understanding of the developmental and evolutionary dynamics of the gap gene network

When the optimal is not the best: parameter estimation in complex biological models

Background: The vast computational resources that became available during the past decade enabled the development and simulation of increasingly complex mathematical models of cancer growth. These models typically involve many free parameters whose determination is a substantial obstacle to model development. Direct measurement of biochemical parameters in vivo is often difficult and sometimes impracticable, while fitting them under data-poor conditions may result in biologically implausible values. Results: We discuss different methodological approaches to estimate parameters in complex biological models. We make use of the high computational power of the Blue Gene technology to perform an extensive study of the parameter space in a model of avascular tumor growth. We explicitly show that the landscape of the cost function used to optimize the model to the data has a very rugged surface in parameter space. This cost function has many local minima with unrealistic solutions, including the global minimum corresponding to the best fit. Conclusions: The case studied in this paper shows one example in which model parameters that optimally fit the data are not necessarily the best ones from a biological point of view. To avoid force-fitting a model to a dataset, we propose that the best model parameters should be found by choosing, among suboptimal parameters, those that match criteria other than the ones used to fit the model. We also conclude that the model, data and optimization approach form a new complex system, and point to the need of a theory that addresses this problem more generally

The Role of Regulated mRNA Stability in Establishing Bicoid Morphogen Gradient in Drosophila Embryonic Development

The Bicoid morphogen is amongst the earliest triggers of differential spatial pattern of gene expression and subsequent cell fate determination in the embryonic development of Drosophila. This maternally deposited morphogen is thought to diffuse in the embryo, establishing a concentration gradient which is sensed by downstream genes. In most model based analyses of this process, the translation of the bicoid mRNA is thought to take place at a fixed rate from the anterior pole of the embryo and a supply of the resulting protein at a constant rate is assumed. Is this process of morphogen generation a passive one as assumed in the modelling literature so far, or would available data support an alternate hypothesis that the stability of the mRNA is regulated by active processes? We introduce a model in which the stability of the maternal mRNA is regulated by being held constant for a length of time, followed by rapid degradation. With this more realistic model of the source, we have analysed three computational models of spatial morphogen propagation along the anterior-posterior axis: (a) passive diffusion modelled as a deterministic differential equation, (b) diffusion enhanced by a cytoplasmic flow term; and (c) diffusion modelled by stochastic simulation of the corresponding chemical reactions. Parameter estimation on these models by matching to publicly available data on spatio-temporal Bicoid profiles suggests strong support for regulated stability over either a constant supply rate or one where the maternal mRNA is permitted to degrade in a passive manner

Gene Circuit Analysis of the Terminal Gap Gene huckebein

The early embryo of Drosophila melanogaster provides a powerful model system to study the role of genes in pattern formation. The gap gene network constitutes the first zygotic regulatory tier in the hierarchy of the segmentation genes involved in specifying the position of body segments. Here, we use an integrative, systems-level approach to investigate the regulatory effect of the terminal gap gene huckebein (hkb) on gap gene expression. We present quantitative expression data for the Hkb protein, which enable us to include hkb in gap gene circuit models. Gap gene circuits are mathematical models of gene networks used as computational tools to extract regulatory information from spatial expression data. This is achieved by fitting the model to gap gene expression patterns, in order to obtain estimates for regulatory parameters which predict a specific network topology. We show how considering variability in the data combined with analysis of parameter determinability significantly improves the biological relevance and consistency of the approach. Our models are in agreement with earlier results, which they extend in two important respects: First, we show that Hkb is involved in the regulation of the posterior hunchback (hb) domain, but does not have any other essential function. Specifically, Hkb is required for the anterior shift in the posterior border of this domain, which is now reproduced correctly in our models. Second, gap gene circuits presented here are able to reproduce mutants of terminal gap genes, while previously published models were unable to reproduce any null mutants correctly. As a consequence, our models now capture the expression dynamics of all posterior gap genes and some variational properties of the system correctly. This is an important step towards a better, quantitative understanding of the developmental and evolutionary dynamics of the gap gene network